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DEVICE, SYSTEM AND METHOD FOR TEMPERATURE SENSING IN AN IN- 

VIVO DEVICE 

RELATED APPLICATION DATA 

The present application is a continuation-in-part of U.S. Application Serial 
Number 09/806,714 filed on October 9, 2001 and entitled "DEVICE AND 
METHOD FOR DARK CURRENT NOISE TEMPERATURE SENSING IN AN IN- 
VIVO IMAGING DEVICE," which in turn claims priority from International 
Application number PCT/I LOO/00470 filed 3 August 2000 and Israeli application 
number 131242 filed August 4, 1999. 

FIELD OF THE INVENTION 

The present invention relates to a method and system for measuring the 

temperature of an environment, such as the interior of the body. 

BACKGROUND OF THE INVENTION 

In many circumstances it is important to measure the temperature inside 

a material body. Such circumstances may occur during industrial processes or 
exploration and analysis processes, such as in geophysical probing or in medical 
diagnostics and treatment of internal parts of the body. 

Conventional thermometry and absolute thermometry are known 
methods for measuring temperature. 

Conventional thermometry is based upon the temperature coefficient of 
properties of materials, such as resistance or mechanical expansion. 

Absolute thermometry is a method which directly measures thermal 
energy of a sensor resistance. This method is based upon the known physical 
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phenomenon of spontaneous thermal noise arising from the Brownian motion of 
ionized molecules within a resistance. 

Thermal noise, which can be discussed in terms of thermal current, 
provides a direct measurement of temperature on a thermodynamic scale, thus 
the Boltzmann constant defines the temperature. The phenomenon of thermal 
noise is derived, for example, in the book: CCD arrays cameras and displays by 
Hoist G.C., p. 128, 2 nd edition, SPIE Press, 1998. A formula that may be used to 
define thermal current is, for example: 

</ n 2 > = frTC 

where k is the Boltzmann constant, T is the temperature of a sensor, and C is the 
capacitance of the sensor. Thus the magnitude of the signals produced by the 
thermal current is directly proportional to the square root of the temperature of the 
sensor. Experiments have indicated that the signal doubles with the increase of 
7°C (degrees Centigrade), which means that a resolution better than 0.1 °C is 
achieved. 

In image sensors, the thermal current produced in an operating 
photodetector device, when no optical radiation impinges on the detector, is called 
"dark current". In CCD cameras dark current is basically charge which 
accumulates in the CCD pixels due to thermal noise. The effect of dark current is 
to produce an additive quantity to the electron count in each pixel. 

US 3,937,086 to von Thuna, US 5,354,130 to Seppa et al. and US 
5,098,197 to Shepard et al. all describe devices for measuring the absolute 
temperature of a body material by receiving and analyzing the thermal noise of 
the body material. 
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US 4,246,784 to Bowen describes a method for noninvasive 
temperature measurement of th interior of a body using the acoustic thermal 
noise spectrum of the measured body. 

None of these temperature measurement methods utilize an image 
sensor to measure the thermal noise of a body material. 

SUMMARY OF THE INVENTION 

Embodiments of the present invention provide a method and system for 
sensing the temperature or temperature change of an environment, such as 
inside a body, by calculating the temperature of an image sensor in the 
environment and deducing the environment's temperature from the image 
sensor's calculated temperature. The temperature or temperature change of the 
image sensor may be calculated by measuring its generated dark current noise. 

Embodiments of the present invention may use an image sensor, in 
which thermal noise is easily detectable, for deducing the temperature of a 
material body, Furthermore, according to embodiments of the invention, a single 
sensor is utilized for obtaining visual data and data relating to the temperature of 
the environment. Thus, diverse information about an environment can be 
obtained utilizing a single sensing device. 

There is thus provided according to an embodiment of the present 
invention a method for sensing the temperature of an environment comprising the 
steps of introducing into an environment an image sensor having an image 
sensing module, sensing the dark current noise of the image sensor, calculating 
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the temperature of the image sensor, calculating the temperature of the 
environment and optionally displaying the calculated environment temperature. 

It will be appreciated that the term "environment" when used herein 
relates to a space enclosed within walls in which it is desired to measure the 
temperature of the space and/or of the walls. 

The temperature of the image sensor is indicative of the temperature of 
it's immediate surroundings and, relying on known factors such as heat 
distribution, distance from the image sensor, etc., the temperature of further areas 
can also be calculated. 

The image sensors utilized in embodiments of the invention can be for 
example digital cameras or video cameras such as vidiocon, CCD cameras or 
CMOS cameras. 

Embodiments of the present invention further provide a system for 
sensing the temperature of an environment. The system comprises an image 
sensor having an image sensing module in communication with an integrating unit 
for detecting the dark current of the image sensor image sensing module and for 
calculating the temperature of the image sensor. The integrating unit may further 
calculate the temperature of the environment or the temperature of the 
environment may be calculated, based on data from the integrating unit, by a 
separate unit that is in communication with the integrating unit, 

The integrating unit may have an amplifying function for amplifying 
signals received from the image sensor. 

The communication between the image sensor and integrating unit can 
be optionally controlled according to the illumination conditions, optionally through 
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a switch which enables communication only during periods in which the sensor is 
not illuminated. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The present invention will be understood and appreciated more fully 
from the following detailed description taken in conjunction with the figures in 
which: 

Figure 1 is a block diagram representing an embodiment of the method 
according to an embodiment of the invention; 

Figure 2 is a schematic illustration of an embodiment of the system 
according to an embodiment of the invention; 

Figure 3 is a schematic illustration of a functional block layout of the 
image sensor according to an embodiment of the invention; 

Figure 4 is a schematic illustration of a medical device comprising the 
system according to an embodiment of the invention; and 

Figure 5 is a block diagram representing an embodiment of a method 
according to an embodiment of the invention. 

DETAILED DESCRIPTION OF THE INVENTION 

In the following detailed description, numerous specific details are set 
forth in order to provide a thorough understanding of the invention. However, it 
will be understood by those of ordinary skill in the art that the invention may be 
practiced without these specific details. In other instances, well-known methods, 
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procedures, components, units and/or circuits have not been described in detail 
so as not to obscure the invention. 

Analytical and diagnostic processes which utilize image sensors to 
monitor environments could benefit from obtaining information relating to the 
temperature of the environment, as a local change of temperature can indicate an 
irregular event. 

For example, some embodiments described in US 5,604,531, which is 
assigned to the common assignees of the present application, describe a 
swallowable device that can pass through the entire digestive tract and operate as 
an autonomous video endoscope. US 5,604,531, is hereby incorporated by 
reference. The swallowable device may include a) a camera system, b) an optical 
system for imaging an area of interest onto the camera system and c) a 
transmitter which transmits the video output of the camera system and/or other 
data. Visual data obtained by the swallowable device can indicate, inter alia, the 
location of pathologies in the gastrointestinal tract. Also a local change of 
temperature in the gastrointestinal tract can be indicative of a pathology. Thus, the 
information obtained by visual means can be complemented and focused by 
information relating to local temperature in the gastrointestinal tract. An external 
receiving, processing and/or display system may receive, process and or display 
data received from the device. 

The method of an embodiment of the present invention may enable 
simultaneous visual monitoring and temperature sensing. 

The method is schematically described by a block diagram shown in Fig. 
1. An image sensor, such as in the above mentioned swallowable device, is 
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inserted 10 into an environment, such as the gastrointestinal tract. The 
swallowable device 30 is typically capsule shaped, but may have other shapes 
and need not be swallowable. 

Illumination is provided intermittently, either by elements connected to the 
5 image sensor itself or by external sources. When illumination is provided 12 
only visual data is obtained 14 and displayed 16. A process for obtaining and 
displaying visual data is described, for example, in the above mentioned US 
5,604,531. 

In an intermittent dark period 11 an integrating unit 100 is activated to 
10 obtain dark current data 13 from the image sensor, though it is not imperative to 
shut off illumination in order to obtain data relating to dark current noise, as will 
be discussed in more detail below. 

The integrating unit 100 is a processor capable of amplifying the obtained 
data 15, if necessary, and calculating the image sensor temperature 17 using 

15 the known equations derived for thermal noise, it will be appreciated that these 
equations are an approximation of a complex phenomenon and that calibration 
should be employed in order to deduce the actual calculations that will be 
applied. According to some embodiments, for example, as schematically 
illustrated in Fig. 5, the image sensor temperature and/or the environment 

20 temperature need not be calculated. Rather, a difference in dark current 
measurements (which are typically indicative of temperature changes) may be 
determined. Thus, a difference in temperature changes may be determined or 
calculated- In one embodiment, the amount of temperature change need not be 
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determined, but rather that a temperature change occurred, and, possible, the 
direction of temperature change (hotter, cooler). 

According to an embodiment of the invention a dark current data sample 
may be obtained (501), for example, according to a predetermined schedule or 
by any other appropriate method (for example, as discussed below). Dark 
current data sample may be compared, for example by using a change detector, 
to a previous dark current sample (502). A difference between two samples can 
indicate a temperature change. According to some embodiments a sample may 
be compared to an average or other manipulation of several previous samples. 
Thus, the actual temperature of the image sensor and/or of the body lumen 
environment need not be calculated. 

According to some embodiments a change in dark current data may be 
displayed (503). According to other embodiments only a change which is above a 
predetermined threshold may displayed. According to yet further embodiments a 
change which is over a predetermined threshold may be used as a trigger for 
changing the activity of other elements of the system. For example, a 
swallowable device, such as described in the above mentioned US 5,604,531, 
may include an integrating unit or other calculating unit which may be capable of 
detecting a change in dark current data, as described above. The integrating unit 
may be in communication with other elements of the device, such as the power 
supply or the illumination system or transmitter of the device, and an ON or OFF 
signal may be generated, typically by the integrating unit, to any of these elements 
in accordance with detected dark current changes. Thus, the operational mode or 
settings of an in vivo sensor can be altered or activated in response to in vivo 
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temperature. According to certain embodiments, a swallowable device may 
include a controller or calculating unit for activating or altering the operational 
mode or settings of the device in response to signals from the integrating unit. 
Such an embodiment may be useful in some case for example, for saving energy. 
According to one embodiment after a device or other in-vivo device is swallowed 
the patient is made to ingest a volume of cold or hot water at regular intervals. 
According to one embodiment the patient ingests cold or hot water over a period 
of a few hours, for example, a period in which the device has most probably left 
the stomach. While the device is in the stomach an ingested volume of cold or hot 
water may cause a change of temperature in the stomach environment. Once in 
the small intestine, the effect of a cold or hot drink is no longer felt. According to 
one embodiment of the invention a change of temperature may be checked at 
predetermined intervals. While a temperature change (typically above a 
predetermined threshold) is detected the device may be kept inactive. If a 
temperature change is not sensed the device may be triggered to activate the 
device. Thus, the device begins collecting data only when it is close to the large 
intestine thereby saving energy and allowing effective and complete action of the 
device in the large intestine. 

The environment temperature or a change in environment temperature is 
then calculated 19, by the integrating unit 100, by a separate unit in 
communication with the integrating unit 100, or possibly by another unit. 
Calculations of the environment temperature may be based on the existence of 
thermal equilibrium between the image sensor and environment. These 
calculations take into account energy dissipation from the image sensor. Local 
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temperature or the average temperature within the environment may be 
calculated, depending on specific requirements. The calculated temperature 
may then be displayed 18. 

It will be appreciated that the various calculations and/or detections may 
be carried out by software or software means executable on computing means 
such as a computer or similar data processors, microprocessors, embedded 
processors, microcomputers, microcontrollers etc. 

The integrating unit 100 may include separate processors, which need 
not all be physically connected. Some of the functions carried out by integrating 
unit 100, such as calculating the image sensor temperature 17 and calculating 
the environment temperature 19, can be carried out in processors that are 
external to the environment and that are fed with data from the integrating unit 
100 by communication such as by IR or radio. Indeed, if an operator is to note 
the temperature of the environment, at least the function of displaying the 
calculated temperature 18 must be performed externally to the environment. 

Integrating unit 100 may be in communication with other units to further 
process and use the data obtained by it. For example, a device, such as 
described in US 5,604,531 , may include a sample chamber for collecting samples 
from the environment of the digestive tract. The process of collecting a sample 
can be controlled by integrating unit 100, such that samples are collected only in 
locations along the digestive tract in which a predetermined temperature is 
prevalent or in which a certain temperature change has been detected. 

Reference is now made to Fig. 2, which is a schematic illustration of the 

system according to an embodiment of the invention. The system includes an 
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image sensor 20 having an image sensing module which includes a pixel array 
(as demonstrated in Fig. 3) in communication with an integrating unit 22. 
Communication is enabled by temperature sense switch 24 which is controlled by 
illumination indicator 26, such that communication is enabled only during dark 
periods, 

When communication between the image sensor 20 and integrating unit 
22 is established, integrating unit 22 receives dark current data from image sensor 
20. 

In an alternate embodiment a switch and/or illumination indicator need 
not be used. According to some embodiments dar1< current data may be received 
from the image sensor 20 continuously or according to a predetermined time 
schedule. For example, a system in which 25 ms light flashes are followed by 475 
ms dark periods, may be programmed to sample dark current data once every 
dark period. In an alternate embodiment a system may include a dark frame once 
every so often, e.g., one frame in every 256 frames is not illuminated. According 
to some embodiments a system may be programmed to sample dark current data 
during a dark frame. Other time periods or intervals may be used. 

It is possible to calculate the image sensor's 20 temperature or 
temperature change based on dark current data obtained from a single pixel of 
the image sensor pixel array, though data obtained from a higher number of pixels 
may achieve more accurate results. It is therefore possible to keep a portion of 
the image sensor's 20 pixels of the pixel array, constantly unexposed to 
illumination, and obtain dark current data from the unexposed pixels, without 
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having to shut off the illumination. Thus simultaneous image capture and and 
temperature sensing may be carried out. 

Thus, dark current data can be obtained also during constant 
illumination by either covering a portion of the pixels of the pixel array or by having 
a portion of the pixel array pixels outside of the image field, e.g. the pixels in the 
periphery of the pixel array. 

The integrating unit 22 may be or include a processor capable of 
amplifying the dark current signal and calculating the image sensor temperature 
from the dark current signal. It may be capable of calculating the environment 
temperature from the image sensor temperature and is capable of displaying the 
calculated environment temperature 21 . Integrating unit 22 may control different 
temperature sensitive units 28, such as a sample chamber, in correspondence 
with predetermined temperatures or temperature changes. A transmitter 29 may 
transmit data such as image data, dark current data, temperature data, and/or 
temperature change data. 

The system may also include a change detector 222 (typically in 
communication with the integrating unit 22) and a controller 225 for activating or 
altering the operational mode or settings of the device in response to signals from 
the integrating unit 22 or another unit. 

The various processing and detecting components described herein/ 
and their functionalities, may be combined over different components than 
separately shown. For example, a single controller may perform all functionality. 
In one embodiment control and calculation capability may be included within 
transmitter 29. 
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Reference is now made to Fig. 3 which is a schematic illustration of a 
functional block layout of the image sensor according to an embodiment of the 
invention. The image sensor typically includes a single chip 40 having an image 
sensing module 42 and a control circuits area 44. The image sensing module 42 

s includes a pixel array 48 for capturing an image. The control circuits area 44 
includes the timing and logic circuitry 47 and A/D circuitry 46. 

Signals can be received from all the pixels of the pixel array 48, Dark 
current is received from pixels that are not illuminated or from pixels during a dark 
period whereas current signals received from an illuminated pixel are the 

10 summation of the dark current and light current of the pixel. The accumulation of 
signals from all the pixels is converted to data which is communicated through a 
transmitter such as transmitter 29 to the integrating unit for decoding and for 
displaying a visual representation and/or the temperature derived from the data. 

The system of an embodiment of the invention will be further described 

15 and demonstrated by Fig. 4 which is a schematic illustration of a medical device 
comprising a system according to an embodiment of the invention. 

The medical device illustrated in Fig. 4 is a swallowable device, 
generally referenced 30. Device 30 which may include components and 
functionality similar to that described in the above mentioned US 5,604,531, but 

20 alternately may be of different construction and include difFerent functionality and 
components. Swallowable device 30 is typically capsule shaped, but may have 
other shapes and need not be swallowable. Swallowable device 30 comprises a 
CMOS camera 32, that is in communication with integrating unit 34. The 
swallowable device 30 further comprises illuminating elements 36 that are in 
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communication with illumination indicator 33. The gastrointestinal tract walls 31 
are illuminated by illuminating elements 36, in intermittent pulses, capturing 
consecutive images of the gastrointestinal tract walls 31 by camera 32, enabling 
an operator to view the gastrointestinal tract walls. Communication between 
camera 32 and integrating unit 34 is enabled in between illumination pulses when 
illumination indicator 33, sensing the lack of illumination, activates the 
temperature sense switch (not shown) to an ON position. 

Alternatively, the illumination indicator 33 may be activated by the 
operator to simultaneously turn off the illumination elements 36 and switch the 
temperature sense switch to an ON position. 

Once communication is established between camera 32 and integrating 
unit 34 dark current signals generated from camera 32 may be received and 
processed, as described above, by integrating unit 34. The calculated 
gastrointestinal temperature, or temperature change may be displayed on a 
display unit external to the gastrointestinal tract. For example, a workstation or 
personal computer may indicate that a change in temperature occurred, the 
direction of temperature change, and/or the amount of temperature change. 
Other body lumens may have temperature or temperature change detected. 

All or part of the functionality of receiving dark current data and 
calculating a temperature or temperature change may be carried out by parts of 
an external receiving, processing and/or display system, such as a remote 
personal computer or workstation. 

Swallowable device 30 may include a sample chamber 35 for collecting 
samples from the gastrointestinal tract environment. The collected sample may be 
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ceils from the gastrointestinal tract walls or a liquid sample from the 
gastrointestinal tract environment. The mechanism for collecting samples, which 
can be any suitable mechanism known in the art, is controlled by integrating unit 
34, such that it is activated in accordance with the gastrointestinal tract 

5 environment calculated temperature. Alternatively, the mechanism can be 
controlled by the operator based on the displayed temperature. 

It will be appreciated by persons skilled in the art that the present 
invention is not limited to what has been particularly shown and described 
hereinabove. Rather the scope of the present invention is defined only by the 

10 claims which follow: 
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